Brain-computer interface with rapid serial multimodal presentation using artificial facial images and voice

نویسندگان

چکیده

Electroencephalography (EEG) signals elicited by multimodal stimuli can drive brain-computer interfaces (BCIs), and research has demonstrated that visual auditory be employed simultaneously to improve BCI performance. However, no studies have investigated the effect of in rapid serial presentation (RSVP) BCIs. In present study, we propose a (RSMP) incorporates artificial facial images voice stimuli. To clarify audiovisual on RSMP BCI, scrambled masked sounds were applied instead stimuli, respectively. Our findings indicated improved performance P300 at Pz contributed classification accuracy. Online accuracy reached 85.7+-11.5%. Taken together, these may aid development better gaze-independent systems.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multimodal Neural Network for Rapid Serial Visual Presentation Brain Computer Interface

Brain computer interfaces allow users to preform various tasks using only the electrical activity of the brain. BCI applications often present the user a set of stimuli and record the corresponding electrical response. The BCI algorithm will then have to decode the acquired brain response and perform the desired task. In rapid serial visual presentation (RSVP) tasks, the subject is presented wi...

متن کامل

An ERP-based Brain-Computer Interface for text entry using Rapid Serial Visual Presentation and Language Modeling

Event related potentials (ERP) corresponding to stimuli in electroencephalography (EEG) can be used to detect the intent of a person for brain computer interfaces (BCI). This paradigm is widely used to build letter-byletter text input systems using BCI. Nevertheless using a BCI-typewriter depending only on EEG responses will not be sufficiently accurate for single-trial operation in general, an...

متن کامل

Collaborative Brain-Computer Interfaces for Target Detection and Localisation in Rapid Serial Visual Presentation

The rapid serial visual presentation protocol can be used to show images sequentially on the same spatial location at high presentation rates. We used this technique to present aerial images to participants looking for predefined targets (airplanes) at rates ranging from 5 to 12 Hz. We used linear support vector machines for the single-trial classification of eventrelated potentials from both i...

متن کامل

A review of rapid serial visual presentation-based brain-computer interfaces.

Rapid serial visual presentation (RSVP) combined with the detection of event-related brain responses facilitates the selection of relevant information contained in a stream of images presented rapidly to a human. Event related potentials (ERPs) measured non-invasively with electroencephalography (EEG) can be associated with infrequent targets amongst a stream of images. Human-machine symbiosis ...

متن کامل

Three stages of facial expression processing: ERP study with rapid serial visual presentation

Electrophysiological correlates of the processing facial expressions were investigated in subjects performing the rapid serial visual presentation (RSVP) task. The peak latencies of the event-related potential (ERP) components P1, vertex positive potential (VPP), and N170 were 165, 240, and 240 ms, respectively. The early anterior N100 and posterior P1 amplitudes elicited by fearful faces were ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computers in Biology and Medicine

سال: 2021

ISSN: ['0010-4825', '1879-0534']

DOI: https://doi.org/10.1016/j.compbiomed.2021.104685